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Abstract 

We present an application of optimal control theory to Dengue epi- 
demics. This epidemiologic disease is an important theme in tropical 
countries due to the growing number of infected individuals. The dynamic 
model is described by a set of nonlinear ordinary differential equations, 
that depend on the dynamic of the Dengue mosquito, the number of in- 
fected individuals, and the people's motivation to combat the mosquito. 
The cost functional depends not only on the costs of medical treatment 
of the infected people but also on the costs related to educational and 
sanitary campaigns. Two approaches to solve the problem are consid- 
ered: one using optimal control theory, another one by discretizing first 
the problem and then solving it with nonlinear programming. The results 
obtained with OC-ODE and IPOPT solvers are given and discussed. We 
observe that with current computational tools it is easy to obtain, in an 
efficient way, better solutions to Dengue problems, leading to a decrease 
of infected mosquitoes and individuals in less time and with lower costs. 
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1 Introduction 

Dengue is a mosquito-borne infection, transmitted by the Aedes aegytpi mosquito, 
that causes a severe flu-hke illness, and sometimes a potentially lethal compli- 
cation called Dengue haemorrhagic fever. Dengue is found in tropical and sub- 
tropical climates worldwide, mostly in urban and semi-urban areas. According 
to the World Health Organization 18 , the incidence of Dengue has grown dra- 
matically in recent decades. About 40% of world's population are now at risk. 

The aim of the paper is to present a mathematical model to study the 
dynamic of the Dengue epidemics, in order to minimize the investments in 
disease's control, since the financial resources are always scarce. Quantitative 
methods are applied to the optimization of investments in the control of the 
epidemiologic disease, in order to obtain a maximum of benefits from a fixed 
amount of financial resources. The used model depends on the dynamic of 
the growing of the mosquito, but also on the efforts of the public management 
to motivate the population to break the reproduction cycle of the mosquitoes 
by avoiding the accumulation of still water in open-air recipients and spraying 
potential zones of reproduction. 

The paper is organized as follows. Section [5] presents the dynamic model for 
Dengue epidemics, where the variables, parameters, and ordinary differential 
equations describing the control system, are defined. In Section[3]the numerical 
implementation and the strategies used to solve the problem are shown. Sec- 
tion |4] reports the obtained numerical results. The main conclusions are then 
given in Section [3 

2 Dynamic model 

The Dengue epidemic model described in this paper is based on the one proposed 
in [3]. It consists in minimizing 

J[ui(-),W2(-)] - / {lDxl{t)+jFulit)+jEulmdt (1) 

Jo 

subject to the following four nonlinear time- varying state equations [5]: 

xi{t) = [an (1 - ^sin(wt + ip)) - au - Xi{t)\ xi{t) — ui{t), (2) 

X2{t) = [aR (1 - A*sin(wt + tp)) - um - Xi{t)] X2{t)+P [xi{t) - X2{t)] x^{t)-ui{t), 

(3) 

±3 {t) = -7]X3 (t) + pX2 (t) [P - X3 it)] , (4) 
±4 (t) = -TX4 (t) + 6X3 (t) + U2 (t) , (5) 
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where Xi{t) = '^^^^'^ , i = 1,...,4. The notation used in the mathematical 
formulation (H}-® is as follows. 

State Variables: 

xi{t) density of mosquitoes 

X2{t) density of mosquitoes carrying the virus 

X3 {t) number of individuals with the disease 

X/^{t) level of popular motivation to combat mosquitoes (goodwill) 

Control Variables: 

Ui{t) investments in insecticides 

U2{t) investments in educational campaigns 

Parameters: 

aR average reproduction rate of mosquitoes 
a M mortality rate of mosquitoes 

/3 probability of contact between non-carrier mosquitoes and infected individuals 
•q rate of treatment of infected individuals 

^ amplitude of seasonal oscillation in the reproduction rate of mosquitoes 
p probability of individuals becoming infected 

9 fear factor, reflecting the increase in the population willingness to take actions to 
combat the mosquitoes as a consequence of the high prevalence of the disease in 
the specific social environment 

T forgetting rate for goodwill of the target population 

Lp phase angle to adjust the peak season for mosquitoes 

uj angular frequency of the mosquitoes proliferation cycle, corresponding to a 52 
weeks period 

P population in the risk area (usually normalized to yield P = 1) 
7£) the instantaneous costs due to the existence of infected individuals 
7i? the costs of each operation of spraying insecticides 
7b the cost associated to the instructive campaigns 



Equation ^ represents the variation of the density of mosquitoes per unit 
time to the natural cycle of reproduction and mortality (a^ and au), due 
to seasonal effects /^sin(a;i + Lp) and to human interference —Xi{t) and ui{t). 
Equation ([3]) expresses the variation of the density of mosquitoes carrying the 
virus X2- The term [a^ (1 — /isin(wt + f)) — um ~ Xi{t)] X2(t) represents the 
rate of the infected mosquitoes and /3 [xi{t) — X2{t)] x^{t) represents the increase 
rate of the infected mosquitoes due to the possible contact between the non 
infected mosquitoes xi{t) —X2{t) and individuals with disease denoted by X3{t). 
The dynamics of the infectious transmission is presented in equation (|4]). The 
term —r/X3{t) represents the rate of cure and px2(t) [P — X3{t)] represents the 
rate at which new cases spring up. The factor [P — x^{t)] is the number of 
individuals in the area, that are not infected. Equation ([5]) is a model for 
the level of popular motivation (or goodwill) to combat the reproductive cycle 
of mosquitoes. Along the time, the level of people's motivation changes. As 
a consequence, it is necessary to invest in educational campaigns designed to 
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increase consciousness of the population under risk. The expression —TX4{t) 
represents the decay of the people's motivation with time, due to forgetting. 
The expression 9x3{t) represents the natural sensibilities of the public due to 
increase in the prevalence of the disease. 

The goal is to minimize the cost functional ([T|). This functional includes 
the social costs related to the existence of iU individuals, jD^Kt), the recourses 
needed for spraying of insecticides operations, jpuKt), and for educational cam- 
paigns, JEU2 {t) . The model for the social cost is based on the concept of goodwill 
explored by Nerlove and Arrow [H]. 

Due to computational issues, the optimal control problem ([T])-(IS|), that is 
written in the Lagrange form, was converted into an equivalent Mayer problem. 
Hence, using a standard procedure (cf., e.g., [10 ) to rewrite the cost functional, 
the state vector was augmented by an extra component X5, 



leading to the following equivalent terminal cost problem: to minimize 



with given tf, subject to the control system ©-© and ([5]). 

3 Numerical implementation 

The simulations were carried out using the following normalized numerical val- 
ues: an = 0.20, an = 0.18, /3 = 0.3, rj = 0.15, n = 0.1, p = 0.1, = 0.05, 
T = 0.1, ^ = 0, w = 27r/52, P = 1.0, jd = 1-0, Jf = 0.4, 7_e = 0.8, xi(0) = 1.0, 
3^2(0) = 0.12, X3(0) = 0.004, and a;4(0) = 0.05. These values are available in the 
paper [3] and were adopted here in order to be able to compare the obtained 
results with those of [3]. It was considered as final time tf = 52 weeks. 

Two different implementations were considered. In the first one, a direct 
approach was followed through the use of the OC-ODE optimal control solver. 
In the second case, with the employment of a nonlinear solver in mind, it was 
necessary to discretize the optimal control problem into a standard nonlinear 
programming problem. 

The OC-ODE 8 , Optimal Control of Ordinary- Differential Equations, is a 
collection of Fortran 77 routines for optimal control problems subject to ordinary 
differential equations. It uses an automatic direct discretization method and 
includes procedures for numerical adjoint estimation and sensitivity analysis. 
In our case the formulation used is optimal control problem ©-([U and ©-(IT]). 

The I PORT [17], Interior Point OPTimizer, is a software package for large- 
scale nonlinear optimization. It is written in Fortran and C. IPOPT implements 
a primal-dual interior point method and uses a line search strategy based on 
filter method. IPOPT can be used from various modeling environments. In this 
work, the problem was coded in AMPL [7 and interfaced to IPOPT. 



±5(0 = jDxlit) + jFulit) + -fEujit), 



(6) 




(7) 
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For the nonlinear strategy, we had to discretize the problem ourselves. It 
was selected a first order method: the Euler's scheme [U |6]. Higher order 
discretization schemes can also be considered, but bringing no advantage [TJ • 

It is assumed that the time t = nh moves ahead in uniform steps of length h. 

dx 

So, if a differential equation is written like — = f{t,x), it is possible to make 
a convenient approximation of this: 

h 

This approximation Xn+i of x(t) at the point tn+i has an error of order h^. 
So it is important to use small enough steps, in order to obtain an accurate 
solution, in spite of allowing a computational efficient scheme. The value h = 
1/4 was found to be a good compromise between precision and efficiency, and 
was adopted here. Thus, the optimal control problem was discretized into the 
following nonlinear programming problem: 



minimize 2:5 (A^) 



xi{i H 


Kl) = 


xi{i) + 

-aM - 


h {[aji (1 — /i sin(a;z + ip)) 
- X4ii)] xi{i) - ui{i)} 


X2{i H 


Kl) = 


X2{i) + 

+/3 [xi 


h{[aR{l - fi sm{uji + ip)) - um - X4{i)] X2(i) 
(i) - X2ii)] X3{i) - uiii)} 


X3{i H 


Kl) = 


2^3 (j) + 


h{~r]X3{t) + pX2it) [P~X3it)]} 


X4{i H 


Kl) = 


Xi{i) + 


h{-TX4{t) + Oxsit) + U2{t)} 


X5{i H 


Kl) = 


X5{i) + 



where j G {0, . . . , iV - 1}. 

The error tolerance value was 10~^ using the I PORT solver. The NEOS 
Server [11] platform was used as interface with the solver. NEOS {Network En- 
abled Optimization System) is an optimization service that is available through 
the Internet. There is a large set of software packages, considered as the state 
of the art in optimization. The discretized problem, after a presolve done by 
the software, is transformed into 1455 variables, 1243 of which are nonlinear; 
and 1039 constraints, 828 of which are nonlinear. 

Next section presents the main obtained results. 



4 Computational results 

The results for the state and control variables are shown in Figures [1] to |6l 
Each figure has three graphics: OC-ODE and I PORT, which correspond to the 
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solutions obtained by the solvers used, respectively; and MSM, corresponding to 
the Multiple Shooting Method [131 [16] that was used by the authors of the paper 
[3]. It is important to salient that, at the time of the initial paper [3], the authors 
hadn't the same computational resources that exist nowadays. The results we 
obtain using described methods (OC-ODE and IPOPT) are better since the cost 
to combat the Dengue disease and the number of infected individuals are smaller. 

Figures [1] and [2] show the density of Dengue mosquitoes. It is possible to 
see that in this new solution, with the same number of mosquitoes than in 
the previous solution [3], the number of infected mosquitoes falls dramatically. 
Figures [31 and [H report to the population in the risk area. Our solution shows 



Density dI niosquitos Density of mosquitoa with virus 




Figure 1: Density of mosquitoes Figure 2: Infected mosquitoes 

that the number of ill people decrease quickly. That is also an explanation for the 
level of motivation to combat the mosquitos to be also lower than the previous 
solution proposed in [3 . Figure [5] shows the accumulated cost. It is clear that 
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almost all year the cost is lower when compared with MSM [3]. This lower cost 
level is a consequence of infected mosquitos and infected individuals both falling 
down under our approach. Figures [3 and [S] are related to the controls applied: 



Figure 5: Cost 



- OC-ODE 

IPOPT 
■ MSM 



20 30 40 50 

time (in weeks) 



educational campaigns and application of insecticides. It is possible to see that 
the new functions for the control variables are more economic. 



5 Conclusions 

At this moment the world, as a result of major demographic changes, rapid 
urbanization on a massive scale, global travel and environmental change, faces 
enormous future challenges from emerging infectious diseases. Dengue illus- 
trates well these challenges [TQ . 

In this work we investigated an optimal control model to Dengue epidemics 
proposed in [3], that includes the dynamics of the Dengue mosquitoes, the effect 
of educational campaigns, and where the cost functional reflects a compromise 
between financial spending in insecticides and educational campaigns and the 
population health. For comparison reasons, the same choice of data/parameters 
as done in j3j was considered. However, the methods used in the paper work 
also for other choices of the data and other problems [111 [15] . 

Until some years ago, due to computational limitations, most of the models 
were run using codes made by the authors themselves. This was the case with 
[3]. Nowadays, one can choose between several proper softwares "out of the 
box", that already take into account specific features of stiff problems, scaling 
problems, etc. With this work it is possible to perceive that "old" problems 
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Application of insecticides Investments in Education Campaigns 




10 20 30 40 50 60 10 20 30 40 50 60 

time (in weeks) time (in weeks) 



Figure 6: Application of insecticides Figure 7: Educational campaigns 

can again be taken into account and be better analyzed with new technology 
and approaches, with the goal of finding global optimal solutions, instead of 
local ones. The optimal control problem [5] was solved here numerically using 
OC-ODE |] and IPOPT [17]. 

The OC-ODE is a specific optimal control software, while IPOPT is a standard 
nonlinear optimization solver. It is possible to verify that, despite the different 
philosophies of the OC-ODE and IPOPT solvers, the reached is exactly the same. 
This fact enforces the robustness of the obtained results. The first software uses 
the optimal control theory in order to reach the solution. The second one, uses 
nonlinear programming as its main tool. It is important to mention that the 
problem under study is a difficult one. Other nonlinear packages were tested, 
and they could not reach to a solution — some crashes at the middle or some bad 
scaling issues were observed. 

The results obtained from OC-ODE and IPOPT coincide and improve the 
ones previously reported in [3] (cf. Section lU . Indeed, the control policy we 
obtain makes big progress with respect to the previous best policy: the percent- 
age of infected mosquitoes vanishes just after four weeks, while mosquitoes are 
completely irradicated after 30 weeks (Figures [T] and [2]) ; the number of infected 
individuals begin to decrease after four weeks while with the previous policy 
this happens after 23 weeks only (Figure [3]). Despite the fact that our results 
are better, they are accomplished with a much smaller cost with insecticides 
and educational campaigns (Figure [5]) . The general improvement done, which 
explain why the results are so successful, rely on an effective control policy of 
insecticides. The proposed use of insecticides seems to explain the big discrep- 
ancies between the results here obtained and the best policy of [3*. Our results 
show that applying insecticides in the first four weeks yields a substantial re- 
duction in the cost of combating Dengue, in terms of the functional proposed 
in [3]. The main conclusion is that health authorities should pay attention to 
the epidemiology from the very beginning: effective control decisions in the first 
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four weeks have a decisive role in the combat of Dengue, and population and 
governments will both profit from it. 

As future work we intend to analyze the model with different parameters 
in the objective function and understand how the heights associated to the 
variables can, or not, influence the decrease of the disease. It will be also 
interesting to analyze other problems, not only those related with the Dengue, 
such as [4], but also with different biological illnesses, such as [2l[5l|9]. 
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